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Abstract. This paper introduces the concept of fitness cloud as an 
alternative way to visualize and analyze search spaces than given by 
the geographic notion of fitness landscape. It is argued that the fitness 
cloud concept overcomes several deficiencies of the landscape repre- 
sentation. Our analysis is based on the correlation between fitness of 
solutions and fitnesses of nearest solutions according to some neigh- 
boring. We focus on the behavior of local search heuristics, such as 
hill climber, on the well-known NK fitness landscape. In both cases 
the fitness vs. fitness correlation is shown to be related to the epistatic 
parameter K. 

Introduction 

The fitness landscape has first been introduced in 1932 by the biolo- 
gist Wright ([4 |) as a metaphor for the visualization of evolution of an 
optimization process. Usually, on the basis of a n-dimensional search 
space, an extra dimension is added which represents the fitness of 
each solution. So, this (n + f )— dimension space can be interpreted 
like a landscape with valleys and peaks. This landscape is more or 
less rough according to the complexity of the problem. However, 
this view of the search space presents some limitations. It is hard 
to visualize a search space of dimension higher than 2; the concept 
of neighboring, induced by a distance, an operator or an heuristic, is 
not easily perceptible; it is difficult to locate, to count or to character- 
ize the set of local optima, as soon as the landscape becomes rough; 
barriers of fitness between basins of attraction are not always high- 
lighted and dynamics of search heuristics cannot be directly tracked 
on the landscape. 

1 The fitness cloud 

This section presents a complementary "point of view" to the geo- 
graphical metaphor of landscape. The search space is noted S and 
the fitness function / is defined on S. 

1.1 Bordering fitness 

Two solutions are regarded as neighbor if there is a transformation re- 
lated to search heuristics or such an operator, which allows "to pass" 
from one solution to the other one. Let s be a solution in the search 
space, its bordering fitness /(s), is defined as the fitness of a particu- 
lar neighbor of s. The choice of one neighbor depends on the search 
heuristic only and we assume this choice to be unique. 
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1.2 Definition 

For each solution in the solution space, a single point is plotted; the 
abscissa is its fitness and the ordinate is its bordering fitness. Thus, 
we obtain a scatterplot which informs about the correlation between 
fitness and bordering fitness (the so-called Fitness Cloud or FC). For- 
mally, FC = {{f(x), f(x)) | x £ S}. A set of neutrality of fitness 
if, so-called S v , is the set of solutions that have the fitness ip. Such 
a set corresponds to one abscissa in the fitness/fitness plan; accord- 
ing to this abscissa, a vertical slice from the cloud represents all the 
fitness values one can reach from this set of neutrality. From a given 
bordering fitness value /, an horizontal slice represents all the fitness 
values from which one can reach /. 

To visualize the shape of the fitness cloud, we plot the three sub- 
sets of FC: FC min = {(f,<p) | f e f (S) , <p = mm /(*)}, 

FCmax = {{<p, <j})\<p€ f(S), <fi = max f(x)} and FCmean = 

{(<P,<f>) \<fi€ f(S), <p = meanf(x)}. 

1.3 Evolvability on fitness cloud 

Evolvability is defined by (2) as "the ability of random variations 
to sometimes produce improvement". There are three specific fitness 
valued (respectively a , (3, 7) corresponding to the intersection of the 
curves (respectively FC m in, FC mean and FC ma x) with the diago- 
nal line (/ = /). So, according to the fitness level ip, four cases can 
be enumerated (see fig.|2]l: 

1. tp < a: bordering fitness is always higher than fitness; applying 
the heuristic confers selective advantage. 

2. a < ip < f3: the mean bordering fitness is higher than fitness. 
Thus, on average the heuristic is selectively advantageous. 

3. f3 < ip < 7: the mean bordering fitness is lower than fitness. Thus, 
on average the heuristic is selectively deleterious. 

4. 7 < ip: bordering fitness is always lower than fitness. The heuris- 
tic is selectively deleterious. 

2 Experimental results on NK-landscape 

The search space is the set of bit-string of length TV = 25. Two 
strings are neighbors if their Hamming distance is one. All experi- 
ments are led on the same instance of NK-landscape with K = 20. 
Datas are collected from an exhaustive enumeration of the search 
spac^J Practically two fitness values are taken as equal if they both 
stand in the same interval of size 0.002. 

2 Existence of which depends on both the problem and the heuristic 

3 A sampling of the search also could be realize if it is large 



2.1 Whole Fitness Cloud 



2.2.1 FC, local optima and epistasis 



We draw scatterplot, the so-called whole fitness cloud including, for 
each string of the search space, all the points in the hamming neigh- 
borhood (see fig[T)- As the density of points on the scatterplot gives 
little information on dispersion, a standard deviation is plotted on 
both side of the mean curve. 
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Figure 1. The whole fitness cloud of NK-landscape with N = 25 and 
K = 20: the fitness cloud (FC) and it shape {FC m i n , FC'max and 
FCmean with standart-deviation) under the hamming neighborhood. The 
FCmean curve is roughly a line. 



A local optimum is a point in the landscape which is higher than 
any of the points which immediately surround it. For such a point, 
the best possible fitness over its neighbourhood is less fit than it; 
so, its bordering fitness is lower than its fitness. Within the cloud, 
local optima fit points under the diagonal line (see fig. [2]r. Such a 
localization gives insight on the amount and the fitnesses of local 
optima. 

Examining the fitness cloud, the set FCmean seems to be coarsely 
supported by a line (see fig.O. As for the whole fitness cloud, we can 
prove that FCmean is a line with the same slope of 1 — -^ii an( j the 
Y-intercept is a constant which depends on N and K. 

2.2.2 Dynamics on the Fitness Cloud under GHC 

We conjecture that the /? fitness level is a barrier of fitness. This 
means that, applying GHC heuristic from a random initial solu- 
tion, on average the search process breaks off around /3. To val- 
idate this hypothesis we conduct a number of experiments on the 
NK-landscape with GHC: the search heuristic is run over 100 gener- 
ations to collect information on the dynamics as the list of successive 
points (/, /) encountered during the search process. All the exper- 
imental datas collected from 70 such runs allows to build an aver- 
age trajectory. As expected this trajectory starts on the FCmean line 
with a fitness near to 0.fJ3, and then roughly follows the FCmean line 
to finally breaks off around the (/3; /3) point (see fig. [2}. Therefore, 
examining the fitness cloud allows to predict the average long-term 
behavior for GHC at fitness level. 



The fact that the FCmean curve computing on the whole scatter- 
plot is roughly a line (see fig[]} confirms the results from Weinberger 
[31: fmean = (l - ^) / + (^) 0.5 As reported by Q], let us 
note that the slope coefficient 1 — -S-tl is the offspring-parent fit- 
nesses correlation. 



2.2 Hill climbing 

A greedy hill climbing heuristic (so-called GHC) is used. 
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Conclusion 

In this paper we have presented the Fitness Cloud as a comple- 
mentary viewpoint to the Fitness Landscape metaphor. FC is a 
2-d representation where the topology induced by an heuristic is 
directly taken into account. Our analytical and empirical results 
suggest that FC allows us to characterize the set of local optima 
and barriers of fitness too. In others experiments on Simulated 
Annealing, we have established that FC can predict the barriers of 
fitness. In such a context, we believe the FC can be used beneficially 
to track the dynamic and to predict the average behavior of the 
search process. To change the metaphor from landscape to cloud 
leads change to the picture from that of a point getting stuck on a lo- 
cal peak to that of a point pulled towards a particular set of neutrality. 
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Figure 2. The thin line is the shape of fitness cloud (FC m in, FCmax and 
FCmean with standart-deviation) under GHC of NK-landscape with N = 
25 and K = 20. The line is the average trajectory of GHC 



4 Fitness of a random initial solution is closed to the mean fitness over the 
search space (/ = 0.5) 



